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Abstract 



A method is developed to distinguish between cars and 
trucks present in a video feed of a highway. The method 
builds upon previously done work using covariance matrices 
as an accurate descriptor for regions. Background subtrac- 
tion and other similar proven image processing techniques 
are used to identify the regions where the vehicles are most 
likely to be, and a distance metric comparing the vehicle 
inside the region to a fixed library of vehicles is used to de- 
termine the class of vehicle. 



Introduction 

There are many potential uses for object identification rang- 
ing from development of automatic key-wording in a photo 
library to determining the weight load on a bridge or spe- 
cific road or possibly estimating air pollution by the different 
types of vehicles present. The specific goal for this paper is 
to develop a method to distinguish and count the number of 
cars and trucks on the road at a given time. 

The problem of identifying vehicles has been mostly re- 
lated to tracking uses, but several have proposed interest- 
ing approaches to the problem. Methods such as deformable 
template matching and template differencing fM Betke 1996[ ) 
have been used for problems that necessitated real-time al- 
gorithms. Slower methods using histograms in the wavelet 
domain were able to detect obj ects from a variety of viewing 
angles (H. Schnelderman 2000). 

The method we used was derived largely from a paper 
about covariance matrices as a distance metric (O. Tuzel 



2006). However since the specific problem we had of identi- 
fying vehicles in a feed of images, we decided to utilize the 
information that could be obtained for comparing temporally 
separated frames. So instead of using region growing meth- 
ods to identify the vehicles we used background subtraction 
and simple image segmentation methods to identify the re- 
gions where vehicles were located. Then we used covariance 
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matrices on these regions to determine what kind of vehicle 
if any was present in the bounding box. 

One of the decisions that must be made before beginning 
to do any kind of analysis is to determine what are the groups 
vehicles are being classified into. Our selection was to define 
smaller vehicles as cars and larger vehicles as trucks with 
the cutoff being around the size of a midsize SUV such as 
a Chevrolet Tahoe. The decision was somewhat arbitrary, 
but the general reasoning behind it was caused by initially 
the small number of trucks present in the data set we chose 
which would be prohibitive of doing extensive testing. Sec- 
ondly though was the simplicity of the separation of car and 
semi-truck. The two objects are vastly different in size and 
demonstrating a complex method using covariance matrices 
could separate these two classes of vehicles would be mini- 
mally informative since a simple pixel counting method could 
perform the task. Thirdly choosing groups that were closer 
together could allow us to investigate what kind of shape in- 
formation in the covariance matrices allows the algorithm to 
make a decision to classify a vehicle as either a car or truck. 



Material and Methods 

Image Acquisition The images used for this project were 
obtained from three separate web cams (AXIS 207W Net- 
work Camera) placed in different rooms and at different view- 
ing angles overlooking the Massachusetts Turnpike (1-90) a 
6 lane interstate with a variety of vehicle traffic. The images 
were taken during a relatively low traffic period to minimize 
ghosting effects and overlapping vehicles and in most occa- 
sions the ambient light present was low enough to not cause 
excess glare or amplify the dirt on the windows. The cam- 
era produced jpeg images with a resolution of 320x240 at 
a frame rate of around 10 frames per second. The different 
angles of the cameras provided a slightly different view of the 
scenery especially of a light pole that partially obstructed the 
view of the cars. In one camera the light pole was almost 
unnoticeable in the other two it blocked a part of the road 
so cars going under the pole were partially obstructed. 
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Image Preprocessing A test image from the camera is 
rotated and then cropped from manual user input in order 
to establish the road and setup the cars to be orthogonal 
to the viewing window so a bounding box is an accurate 
way to express the boundaries of the car. If the car was 
moving in a diagonal fashion the bounding box would contain 
a significantly larger amount of empty space which would 
'water-down' many of the calculations later possibly enough 
to make distinction between a car and a truck impossible. 

Background Subtraction In order to remove the in- 
formation that does not pertain to the objects and ve- 
hicles in the image the average image from the data set 
is subtracted. Given a color image set H of dimension 
W X H X # of Color Channels x Images we calculate the 
background for the data set by the following formula 

1 ^ 

B{x, c) = — ^ H{x, y, c, n) (1) 

n=l 

In order to calculate a given image to be used for in the 
processing the background image is subtracted and the im- 
aged is converted to grayscale by averaging each of the color 
channels 



1 ^ 

Hk{x,y) = - ^\H{x,y,c,k) - B{x,y,c)\ 



(2) 



Image Cleaning The process of identifying objects and 
vehicles from the image //e(x, y) is a very difficult one, but is 
essential for determining a car or a truck. The first step is 
to create a cleaned up version of the image. This is accom- 
plished by first using a median filter with a [5 x 5] neighbor- 
hood. 

H'^{x, y) = MedianFilter(i7^(x, y)) (3) 

The next step is to remove all the low valued pixels by shift- 
ing the image down by 20 and removing all the negative 
numbers. 



h{x,y) 



H'^{x,y)<l{) 



(4) 



0, 

H'^{x,y)-l(), H'^{x,y)>10 

Binary Image A binary image is important for segmenta- 
tion process since a grayscale image would contain too much 
information to use standard MATLAB methods. A new im- 
age is created from the image and an amplified version of 
the edges in the image. The Edges term is binary image 
created from doing a canny edge detection on the image. 

y) = Ik{x, y)^10x Edges{/fe(x, y)} (5) 

The image is then converted to a binary image using intensity 
cutoff 



1 1, Ki^. 



1 

N X W X H 



N W H 



(6) 



(7) 



/i is the average value over all images in the data set to 
prevent images absent of cars to have the noise amplified 
disproportionately. 

Segmentation From the binary image separate objects 
are detected by finding all the pixels that formed contigu- 
ous groups of more than 60 pixels each of these groups was 
labeled as a region i out of L, size by H^, starting at 
point (xi, yi) in image /^'(x, y) Ri,k{x, y) = I'^^Xi^x, yi + 
y)\/[{x^y) ^ (Wi,IIi)] For each of these regions a mean (a 
mean in a binary image represents the percentage of pixels 
turned on) /^was calculated as follows. 



(8) 



x'=l y'=l 



Since I'j^{x^y) is a binary image and Ri^k{x^y) G I'j^^x^y) 
then < /i < 1. 

• If /i < 0.45 and the value of x > lAmpx'^ the 
object is assumed to contain multiple cars that are out of 
alignment and therefor have quite a bit of empty space 
resulting in a low fi value. In o rder to seperate the se 
two objects a 'k-means algorithm' (JL Marroquin 1993) is 
used to search for two groups of pixels inside the region 
Ri^k from this two new regions are created. 

• If /i > 0.80 and the value of x < 340px2 the object 
is assumed to contain a portion of a vehicle (windshield, 
hood, etc.). The assumption is then that there are nearby 
segments containing the other parts of this s ame car so 
a "k-means algorithm" (JL Marroquin 1993) is used to 
search for L — 1 groups. 

• If Wi X Hi < 200px^ and none of the other conditions are 
true the section is deleted 

Each of these groups was taken and a bounding box was 
determined. If the number of and the samples from Ik{x^y) 
inside the box are used to calculate the covariance matrix. 

Feature Vectors The feature vector used in the Region 
Covariance paper (O. Tuzel 2006) requires revision since our 
task requires correctly identifying cars from trucks. In that 
paper they were trying to identify specific objects that were 
moving around not classes of objects. So color information is 
going to be ignored as trucks are not significantly differently 
colored than cars. The most successful feature vectors used 
on our data set have been. 



^ x,y 



^ y ^ ^ V2J(x,y) ] (9) 



^2 dljx^y) dl{x,y) 
dx dy 



[ X y V^I{x,y) Edges(/(a;,y)) ] 



(10) 
(11) 



k' = l x' = l y' = l 



r = {x — xq)'^ {y — HqY represents the distance the given 
pixel is away from the center of the region (xo,^o) = (^i + 
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+ The use of R over x and y was investigated 

since using a rotation invariant variable would allow the car 
to be going the opposite direction or changing lanes and still 
produce a similar feature vector. The derivatives in the x 
and y directions are approximated by convolution with the 
3x3 matrix Sobel in x and y 



d_ 

dx 



-1 1 
-2 2 
-1 1 



A. 

dy 



1 



-1 



1 



-1 



(12) 



The laplacian is approximated by a convolution using the 
3x3 Laplacian matrix. 



-1 



(13) 



Covariance Matrices The covariance matrix Ck for a 
given region Rj.{x^y) was calculated by creating a feature 
vector Fi for each point (x^y) ^i = x-\-{y — 1)^ Wi in 
the region resulting in N total points. jii{u) represents the 
average value of the feature value u for all the pixels in the 
region. 



1 ^ 

Ck{u, v) = - ^(F,(ii) - fi{u)){F,{v) - fi{v)) 



(14) 



The distance between two covariance matrices is calculated 



using a previously developed method (W. Forstner 1999). 



p(Cl,C2) 



^In^ Ai(Ci,C2) 



(15) 



Where Ai(Ci,C2) repesents the generalized eigenvalues be- 
tween Ci and Ci. While this metric is likely non-optimal, it 
satisfies the requirements for a distance metric and is easily 
and quickly calculated using MATLAB 

Ontology Creation One image set was selected as con- 
taining a large amount of diversity of vehicles and overlaps 
to develop the library of covariance matrices divided into 4 
categories {Car, Truck, Multiple, Junk}. Multiple was cre- 
ated to represent when two vehicles were overlapping enough 
to be identified by the segmentation algorithm as the same 
vehicle. Junk was created when the algorithm would iden- 
tify just a portion of a vehicle or when the vehicle is partially 
out of frame. The method then determined what class of ob- 
ject a given region Ri contained by calculating the distance 
between Ci and every matrix in the library. The minimum 
distance was then taken and the region would be identified 
as the same class as the object it was closest too. 

Results 

Some of the results produced by the algorithm are listed 
in quantitative from in Table [l] The only feature vector 



Table 1. Quantitative Results 



Length 


# Cars 


Sensitivity 


Specificity | 


15 frames 


16 


93.75% 


0% 1 


Length 


# Trucks 


Sensitivity 


Specificity 


15 frames 


2 


100% 


100% 



11 . The 



used to produce these specific results was Equation 
others were used initially but this one appeared to work the 
best. The sensitivity and specificity terms are defined in the 



appendix under Equations 



respectively. 



The table is from a fairly simple scene typical in low traffic 
conditions where there is minimal overlap of the vehicles, and 
for this scene it works very well only making a mistake on 
one frame and the mistake was in the segmentation (Figure 
[4| the algorithm's only mistake was to label the two partial 
car segments both as cars instead of junk. The specificity 
number could probably be greatly increased by an improved 
segmentation. 

obi 



Figures 
tect all the 



demonstrate the algorithm's ability to de- 
jects in the scene and properly identifying the 
cars. The pictures in Figure [2] show the background sub- 
tracted images with the bounding box and indentification. 
The ghosting sort of effects that appe ar as the image set 
gets small appears strongly in images |2(b)|2(d)| . In this 
image set the effect was weak enough to not cause false iden- 
tification of objects, but the ghosting effects can cause quite 
a few issues as discussed later. 

Discussion 

The algorithm worked suprisingly well on most of the im- 
ages even difficult images as demonstrated in Figure [3j The 
program seemed to work very well regardless of how the cam- 
era angles and lighting changed from image set to image set. 
Figure [3] shows the correct identification of all vehicles in 
the picture using an ontology that was created using a cam- 
era looking the other direction. The algorithm success was 
almost entirely limited by the success of the segmentation 
algorithm on the image. 

Shortcomings The segmentation algorithm was able to 
manage most of the images very well; however, several of the 
images managed to produce erroroneous regions that either 
contained multiple cars (Figure 2(d)| ) or regions that con- 
tained portions of cars (Figure [4). One of the largest po- 
tential problems with this method is the distances between 
objects within the library. Small distances between them 
would mean the difference in distances between a given re- 
gion and an object in the car class and an object in the truck 
class could be quite small. With these differences being quite 
small the proper identification could be thrown off my small 
noise artifacts in the image. Although there were some cases 
such as Figure [sj [g] where the distance metric was not dis- 
tinct enough to separate the vehicles in most cases it seemed 
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(a) Good multiple car detection 




(b) Good truck detection 




(c) Overlapping Vehicle detection 




(d) Good multiple object detection 
Figure 1. Normal Images 
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(c) Good partial truck detection 
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(d) Good multiple object detection 
Figure 2. Background Subtracted Images 
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(a) Car detection with pole obstruction 




(b) 3 overlapping cars detection and junk detection 



to work well. 

One of the most interesting failures of the algorithm that 
was actually found because of a bug in the program was 
an object that was eqi-distant from both the car and the 
truck using the metric (Eq 15). The picture of this object 
is shown in (Figure |5|. Lines on the road show up on the 






- * 

















(c) Truck detection 



(d) Truck detection with pole obstruction 
Figure 3. Difficult Images 



Figure 5. The vehicle equidistant (using Equation [Ts]) between a 
car and a truck (the 'eigenvehicle') 

background subtracted images as lines on the vehicle. This 
causes possible extra edges to appear inside the car where 
there is nothing. This effect was noticeable in several of the 
images, but it did not seem to pose a problem when classi- 
fying the type of image. However it is fairly easy to imagine 
a configuration where this could pose a real problem. 

What is a truck? For the purposes of our project a truck 
was really just defined as a vehicle that was noticeably larger 
than a sedan. So a Jeep or small pickup would not be consid- 
ered a truck, but a Hummer, passenger van, and large pickup 
would be. Clearly a large vehicle or semi-truck would always 
be considered a truck, and a small sedan or a 5 passenger 
SUV would be considered a car. This method worked well 
on the vehicles which fell on the extremes of being a car or 
a truck but several vehicles in between were poorly identi- 
fied by the algorithm. The vehicle would switch between car 
and truck since the distance difference between the two was 
quite small. A great example of this is the station wagon 
(Figure [6|. Furthermore many car manufacturers today de- 
velop trucks to look like cars and cars to look like trucks so 
one would expect that these vehicles might be classified in- 
correctly which again reiterates the importance of having a 
solid definition of vehicle types for classification. 
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Figure 6. Station wagons were often inconsistently classified from 
frame to frame 

Assumptions and Limitations The first assumption is 
the camera is fixed so the rotation and cropping procedure 
needs to only be done once per camera and within an im- 
age set the only changes would be related to vehicle motion. 
Some assumptions being made about the size of the image 
set is that it is large enough that the average image is an 
accurate representation of the background, yet small enough 
in comparison to the time-scale of a day to be significantly 
altered by sunrise or sunset. A time sample of up to about 
15 to 30 minutes is about the maximum time length for this 
invariance to be true and a sample of at least 50 images is 
required for the average image to be free of ghosting. Addi- 
tionally the cars are assumed to be moving quickly only in 
view for several seconds at most. Conditions such as bumper 
to bumper traffic would give a poor average image and a sig- 
nificant amount of vehicle overlap. 

Future Work 

A deeper investigation needs to be done on what really de- 
fines a car or truck from the covariance statistics. This 
would allow us to understand exactly which variables play 
the largest roles in the determination of a vehicle, further- 
more this might allow for the development of a better suited 
metric for measuring distance instead of logs of eigenvalues 
it might be possible to compare several elements of the co- 
variance matrix. 

For our project the algorithm was qualitatively tweaked 
and optimized. While this is much easier to do than de- 
veloping quantitative methods, it is probably flawed. The 
algorithm needs to be tested more extensive and statistics 
about sensitivity and specificity for car and truck detection 
need to be determined for this method to be useful in a real 
world setting. The algorithm also needs to be compared 
to other simpler algorithm's to determine its relative abil- 
ity to properly identify cars. For example in many of the 
image sets it appeared that a measurement of the bound- 
ing box area would have been a closer match to the vehicle 
type than using the significantly more complicated and com- 
putationally intensive covariance matrix method. Also the 
problem is probably not properly defined. There are many 
more classes of vehicles than we described. There are mid- 
size, motorcycles, and all sorts of different SUV's that were 
lumped into either car or truck based on their relative size 
which probably weakened the algorithm's ability to discern 



between these middle class of vehicles. 
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Appendix 

Sensitivity and Specificity 

Although these are generally used for medical statistics they have been used as a good measure for the tests especially in 
reference to proper junk identification when segmentation produces faulty regions. For these test the gold standard is a 
human user looking at each frame and identifying the number of cars and trucks they see, and then looking and how the 
program identified everything to determine the number of junk regions labeled as car or truck. A junk region would be all 
three regions in the splitting picture since none of them represent accurately a car (Figure [4| . So the sensitivity test tests 
the both the segmentation and accuracy of the minimum distance finding/covariance matrix ontology. The specificity test 
just shows the accuracy of the minimum distance finding/covariance matrix ontology because a statistic representing how 
often the algorithm correctly identified the absence of a car would be too saturated because the test does work in most 
cases. The specificity is just how well the program labeled the regions that were found as junk. For example a region that 
just contained a roof would be junk or contained two portions of different cars should be junk. 

Correctly Identified Cars/Trucks , . 

Sensitivity = (16) 

Total Number of Cars/Trucks 
Correctly Identified Junk , . 

Specificity = (17) 

Junk Labeled as Cars/Trucks -\- Correct Junk 

Background Subtraction/ Cleaining Code 

function [jk,rk] =loaddata() 

d=menu( 'Select File Loading Method^ 'Folder 'File (s) O ; 
if d==l 

path= [uigetdir '\'] ; 

f iles=dir ( [path '*.jpg']); 

f ilen=f iles . name ; 
else 

[f ilen, path] =uigetfile('*. jpg;*. JPG' , 'JPEG Image' , 'Multiselect ' , 'on') ; 
if ischar (f ilen) 
f ilen=f ilen; 

end 
end 

test=imread( [path filenl]); 
imshow(test) 

uiwait (msgboxC 'Click the bottom line of the image')); 
[y,x] =ginput (2) 

thet=180/pi*atan(dif f (x) /dif f (y) ) ; 
test=imrotate(test ,thet , 'bicubic' ) ; 
imshow(test) ; 

uiwait (msgboxC 'Click the boundaries of the image')); 

[y,x] =ginput (2) 

x=round(x) ; 

y=round(y) ; 

k=[]; 

for jb=l : length(f ilen) 

test=imread( [path filenjb]); 
test=imrotate(test ,thet , 'bicubic' ) ; 

k( : , : , : , jb)=double(test (min(x) :max(x) ,min(y) :max(y) , : ) ) ; 
end 

test=mean(k,4) ; 

jk=[]; 

rk=[]; 

for jb=l : length(f ilen) 

clmg=abs(k( : , : , : , jb)-test) ; 
jk( : , : , jb)=mean(clmg, 3) ; % convert to psuedo grayscale 
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f indcars(jk( : , : , jb) ) ; 
pause ( . 1) ; 
end 

rk=uint8(k) ; 

Ground Truth/Ontology Creating Tool 

function [imdb , obdb] =labelcars (imgs , realim, obdb , imdb) 
if nargin<3 
"/ocard 

obdbl . covs= [] ; 
iindbl=[] ; 
"/otruckdb 
obdb2 . covs= [] ; 
iindb2= [] ; 
°/omultidb 
obdbS . covs= [] ; 
iindb3= [] ; 
°/o j unkdb 
obdb4. covs= [] ; 
iindb4= [] ; 
end 

colormap ( ^ bone ^ ) ; 
for k=l : size(iings,3) 

[xmin , xmax , ymin , ymax] =f indcar s ( imgs ( : , : , k) , 0) ; 

f k=f eatureimCiings ( : , : ,k) ) ; 

for j=l : length (xmin) 

imshow(realim( : , : , : ,k) ) ; 

line ( [xmin( j ) xmax(j)] , [ymin(j) ymin(j)]); 
line( [xmin(j) xmax(j)] , [ymax(j) ymax(j)]); 
line ( [xmin( j ) xmin(j)] , [ymin(j) ymax(j)]); 
line( [xmax(j) xmax(j)] , [ymin(j) ymax(j)]); 
°/o[xmin(j) ,xmax(j) ,ymin(j) ,ymax(j)] 
"/of igure 

yoimagesc(imgs(ymin(j) :ymax(j) ,xmin(j) :xmax(j) ,k)) 



f i=f k(ymin( j ) :ymax(j) ,xmin(j) :xmax(j) , : ) ; 

c=cov (reshape (fi , size(f i , 1) *size(f i ,2) , size(f i ,3) ) ) ; 

a=menu( identify Object' , ignore' , 'Car' , 'Truck' , 'Multiple' , ' Junk')-1; 
if a>0 

ing=imgs(ymin(j) :ymax(j) ,xmin(j) :xmax(j) ,k) ; 

if isempty (obdba. covs) 

obdba . covs ( : , : , end) =c ; 

imdba. imgsl . img=ing; 
else 

obdba . covs ( : , : , end+1) =c ; 
imdba. imgs end+1 . img=ing; 
end 
end 

end 
end 
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Image Cleaning and Segmentation Code 

function [xmin , xmax , ymin , ymax] =f indcars (iingin,dp) 
if nargin<2 

dp=l; 
end 

iingin=inedf ilt2(iingin. *(iingin>10)-10, [5 5]); 

iing=iingin+edge (imgin, ^ canny ^ , .2)*10; 

biing=bwareaopen(iing>15 , 80) ; 

xinin=[] ; 

xinax=[] ; 

yinin= [] ; 

yinax=[] ; 

[biing,n] =bwlabel (bimg) ; 
if dp 

images c (bimg) ; 
end 
k=l; 

while k<=n 

tlmg=(bimg==k) ; 

xl=f ind(mean(tlmg) >0) ; 

yl=f ind(mean(tlmg^ ) >0) ; 

ttlmg=tlmg(min(yl) :max(yl) ,min(xl) :max(xl)) ; 
pn=mean(mean(ttlmg) ) ; 

if pn<.45 & (sizeCttlmg, 1) *size(ttlmg,2) ) >350*4 % probably 2 vehicles, lots of empty space 
dispC'KMean Split O ; 
iblmg=ikmeans (timg, 2) ; 
[x,y]=f ind(bimg==k) ; 

bimg(x,y)=0; % delete the current one 
bimg=bimg+(iblmg==l) *k; 
bimg=bimg+(iblmg==2) * (n+1) ; 
imagesc (bimg) 
n=n+l ; 

elseif pn>.8 & (size(ttlmg, 1) *size(ttlmg,2) ) <340 % probably part of a vehicle 
dispCMunk Filter O ; 
if n>2 

bimg=ikmeans (bimg>0 ,n-l) ; 
end 

xmin= [] ; 
xmax=[] ; 
ymin= [] ; 
ymax= [] ; 
k=l; 
n=n-l ; 

elseif (sizeCttlmg, l)*size(ttlmg,2))<250 
bimg=bimg-k* (bimg==k) ; Xremove section 
k=k+l; 

else 

xmin(end+l)=min(xl) ; 
xmax(end+l)=max(xl) ; 
ymin(end+l)=min(yl) ; 
ymax(end+l)=max(yl) ; 
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if dp 

line ( [xminC end) xinax(end)] , [yinin(end) yinin(end)] ) 
line ( [xminC end) xinax(end)] , [yinax(end) yinax(end)]) 
line ( [xminC end) xinin(end)] , [yinin(end) yinax(end)]) 
line ( [xmaxC end) xinax(end)] , [yinin(end) yinax(end)]) 

end 

k=k+l; 

end 
end 



Identification Code 

function identif years (imgs , realim, obdb) 
yoident if years (imgs , real im, obdb) 
eolormap ( ^ bone ^ ) ; 
for k=l : size(iings,3) 

[xmin , xmax , ymin , ymax] =f indear s ( imgs ( : , : , k) , 0) ; 

iinshow(realiin( : , : , : ,k) ) ; 

for j=l : length (xmin) 



line ( [xmin( j ) xmax(j)] , [ymin(j) ymin(j)]); 
line( [xmin(j) xmax(j)] , [ymax(j) ymax(j)]); 
line ( [xmin( j ) xmin(j)] , [ymin(j) ymax(j)]); 
line ( [xmax( j ) xmax(j)] , [ymin(j) ymax(j)]); 
yo[xmin(j) ,xmax(j) ,ymin(j) ,ymax(j)] 
Zf igure 

"/oimagese (imgs (ymin( j ) :ymax(j) ,xmin(j) :xmax(j) ,k)) 
elmg=imgs (ymin(j ) :ymax(j) ,xmin(j) :xmax(j) ,k) ; 
f i=f eatureim(elmg) ; 

e=eov (reshape (f i , size (f i , 1) *size(f i , 2) , size (f i ,3) ) ) ; 
dists=ealedist (obdb, e) ; 
obj=f ind(dists==min(dists) ) ; 
obj=obj (1) ; 
switeh obj 
ease 1 

txt='Car^ ; 
ease 2 

txt=^Truek^ ; 
ease 3 

txt=' Multiple^ ; 
ease 4 

txt= ^ Junk^ ; 
otherwise 
txt=^ err ^ ; 

end 

text((xmin(j)+xmax(j))/2, (ymin(j)+ymax(j) )/2,txt , 'Color' , [1 0] ) 



end 

menu ( ' Ready? ' , ' Yes ' ) ; 
end 



K-means Segmentation Code 

f unetion [segimage] =ikmeans (img, groups) 
[x,y] =f ind(img) ; 
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u=kineans ( [x ^ ; y ^ ] \ groups , Mist \ ^ city ^ ) ; 
segiinage=zeros (size (img, 1) , size (img, 2) ) ; 
for k=l: groups 

yosegimage (x (u==k) , y (u==k) ) =k ; 

xk=x(u==k) ; 

yk=y(u==k) ; 

for z=l : length (xk) 

segimage (xk (z) , yk (z) ) =k ; 

end 
end 

Feature Vector /Image Creation Code 

function f d=f eatureiin(k) ; 
intlabd=0; 
fd=[]; 

°/o position values 

xax= [1 : size(k, 1)] ^*ones(l,size(k,2)) ; 
yax=( [1 : size (k, 2)] ^ *ones (1 , size (k, 1) ) ) ^ ; 

sobel=[[-l 2 -1] ; [0 0] ; [1 2 1]] ; 

lapl=[[0 -1 0];[-l 4 -1] ; [0 -1 0]]; 

lap2=[[-l -1 -1];[-1 8 -1] ; [-1 -1 -1]]; 
"/of d( : , : , l)=sqrt (xax . ''2+yax . '^2) ; % First axis is distance from center 
f d( : , : ,end)=xax; 
f d( : , : ,end+l)=yax; 
yoimage intesity 
fd(: , : ,end+l)=k; 

if intlabd==l % diff command 

% first order derivative 

fd(: , : ,end+l)=zeros(size(k, 1) ,size(k,2)) ; 

fd(2:end, : , end) =abs (diff (k, 1 , D ) ; 

fd( : , : , end+l)=zeros (size (k, 1) ,size(k,2)) ; 

fd(: ,2:end,end)=abs(diff (k,l,2)) ; 

y second order derivatives 

fd(: , : ,end+l)=zeros(size(k, 1) ,size(k,2)) ; 

fd(3:end, : , end)=abs (dif f (k,2 , 1) ) ; 

fd( : , : ,end+l)=zeros(size(k, 1) ,size(k,2)) ; 

fd(: ,3:end,end)=abs(diff (k,2,2)) ; 
elseif mtlabd==2 

f d( : , : , end+l)=conv2 (k, sobel , ' same ' ) ; ^vertical 
fd( : , : ,end+l)=conv2(k, sobel' , 'same' ) ; ytLorizontal 

% f d( : , : , end+l)=conv2 (k, lapl , ' same ' ) ; Xfirst laplacian approximation 

f d( : , : , end+l)=conv2 (k, lap2 , ' same ' ) ; ysecond laplacian approximation (includes diagonals) 
else 

fd( : , : ,end+l)=conv2(k,lap2, ' same' ) ; 
fd( : , : ,end+l)=edge(k, 'canny' , .2) ; 
end 



Covariance Matrix from Feature Vector Code 

function c=gencov(img) 
figure (1) 
images c (img) ; 
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[y,x] =ginput (2) ; 
x=round(x) ; 
y=round(y) ; 

f i=f eatureiin(iing(x(l) :x(2) ,y(l) :y(2))) ; 

c=cov (reshape (f i , size (f i , 1) *size (f i , 2) , size (f i , 3) ) ) ; 



